Methods for retrieving database with image information

ABSTRACT

In a DB retrieval method, a two-step retrieval including quantitative and qualitative retrievals is interactively performed so that, through the operation of image information (e.g. map information) having a correspondence to a DB having text information such as attribute information stored therein, attribute information corresponding to the map information is retrieved from the DB. The quantitative retrieval includes a DB information reading process for reading image information, attribute information and information relevant thereto, and a quantitative retrieval process for making a quantitative retrieval including the partial overlaying of another information for retrieval on the original image information (or map information) or a rough retrieval with the other information used as a retrieval key called information lens, and storing the result of retrieval into a work file. The qualitative retrieval includes a DB information reading process for reading image information, attribute information and information relevant thereto, which are stored in the work file, and a qualitative retrieval process for making a qualitative retrieval in which the original image information (or map information) is overlaid with a retrieval key called a function sheet including the composition of a qualitative retrieval condition and an image indicative of a range of application of the retrieval condition, and displaying the result of retrieval on a terminal.

BACKGROUND OF THE INVENTION

[0001] The present invention relates to a method for retrievinginformation with image information and text information being linked toeach other, and more particularly to a method for retrieving informationwith a plurality of image information being overlaid each other in alimited area.

[0002] The plan concerning an area has conventionally been made in sucha manner that the feature or the like of that area are investigated byusing a map and detailed information is acquired by retrieving arelational information database (hereinafter abbreviated to DB)concerning that area. Usually, a describing language or SQL (StructuredQuery Language) for retrieval is used for the retrieval of DB.

[0003] For example, a retrieval system using text information has beendisclosed by JP-A-5-165401 entitled “MAP RETRIEVAL SYSTEM”. In thedisclosed system, a map database is retrieved with a telephone numberused as a key for getting the result of retrieval so that thecorresponding map is displayed and a marking is made at a position onthe map corresponding to the telephone number. In displaying the map, anaddress and a subscriber's name associated with the telephone numberacquired by retrieving the database are displayed.

[0004] Also, JP-A-4-155474 entitled “IMAGE PROCESSING METHOD AND SYSTEM”has disclosed a preferred image processing method in which attributeinformation of an area to be retrieved on an arrangement diagram such asa map or layout is outputted with a correspondence to an area on thearrangement diagram. The disclosed method includes inputting anarrangement diagram, inputting a figure to define the boundary of apredetermined area in the arrangement diagram by use of an image inputdevice, overlaying the inputted arrangement diagram with the boundarydefining figure, and storing the overlaid composition of the diagram andthe figure into a memory, thereby facilitating the processing ofinformation concerning the predetermined area in the arrangementdiagram.

[0005] A city planning operation in an example of planning operationsusing maps. In the city planning operation, a development planning isinvestigated and made on a desk on the basis of various materials ordata. The materials include maps such as city planning map, residentialmap and cadastral map, and information which is stored in a database(DB) and concerns residents and fixed properties.

[0006] In many cases, the city planning operation includes thefollowings works.

[0007] (1) A person acquires personal information concerning residentshaving their homes in a designated area or landowners possessing theirlands in the area, administrative information concerning regulationsdefined in that area, and information shown in various maps and makesmutual reference to the information.

[0008] (2) He processes a work similar to the above work (1) whilepartially changing the area. In this case, he may change conditions foracquiring the other information while referring to the acquiredinformation. Thus, the investigation of a planning about a plurality ofareas requires roughly getting the information of the areas andinvenstigating each area while making the comparison with the roughinformation obtained for the areas.

[0009] (3) A work similar to the above work (1) is repeated by not onlychanging an area to be investigated but also selecting informationcorresponding to the investigation.

[0010] Namely, the planning operation is made in many cases in such amanner that the operation and investigation are made whilesimultaneously viewing a plurality of maps for the same area. Forexample, in the case where a plan of a new road is to be made, it isnecessary for him to know information concerning residents in areasalong the new road by use of a residential map for the purpose of quitnegotiation and by using a map indicative of the ownership of lands toknow information concerning the landowners and regulations determinedfor the respective areas.

[0011] However, it is difficult for him to plan while simultaneouslyreferring to the plurality of maps and confirming detailed residentinformation and land information in the DB. The reason is that in theconventional system, the map and the DB are realized without a relationto each other and he must make the DB retrieval of relevant informationwhile departing from the map once.

[0012] In many cases, it is general that information necessary for aplanning operation has its value in a locational relation (such asarrangement) displayed on a plan or diagram such as a map. In theconventional system, information retrieved from a DB is used in a formwritten down in the map. Therefore, the reference to the locationalrelation requires extra labor and a retrieval range is limited in manycases.

[0013] In the conventional system, since a system for displaying mapsand a system for retrieving DB's are realized as separate systems, it isrequired that the retrieval of the DB having information stored thereinand relevant to the maps should be made separately from a work of usingthe maps. For such circumstances, in the retrieval system using textinformation disclosed by JP-A-5-165401 entitled “MAP RETRIEVAL SYSTEM”,the retrieval of DB information relevant to a map is made by retrievinga map database with text information of a telephone number used as a keyfor getting the result of retrieval so that not only a relevant map butalso text information associated with the telephone number aredisplayed. However, this prior art has no disclosure as to a solutionfor globally understanding a map and selecting objects from the map.

[0014] On the other hand, in the method disclosed by the JP-A-4-155474entitled “IMAGE PROCESSING METHOD AND SYSTEM”, the processing ofinformation concerning a predetermined area in an arrangement diagram isfacilitated by performing an image processing in which the arrangementdiagram is overlaid, by use of a marker, with a figure to define theboundary of the predetermined area in the arrangement diagram. However,this prior art has no disclosure as to a method of designating thepredetermined area while making the trial of retrieval. Also, in thecase where an SQL is used for retrieval, not only the retrieval requiresa considerable labor but also it is impossible for him to make thedirect observation of the change of information on a map in the processof retrieval in a trial-and-error manner.

SUMMARY OF THE INVENTION

[0015] An object of the present invention is to provide a DB (database)retrieval method in which when a DB having text information storedtherein and linked with image information such such a map is retrievedon the basis of the image information, a proper object of retrieval canbe selected from massive information of the DB on the basis of arelation of the image information to another image information and a DBretrieval condition and a range of application thereof can easily be setimagewise on the image information.

[0016] Another object of the present invention is to provide a retrievalmethod which is capable of easily understanding the correspondence ofplural kinds of maps concerning the same area to detailed informationconcerning each map.

[0017] A further object of the present invention is to provide a methodwhich is capable of easily retrieving a DB relevant to a map bycomposing at least one retrieval condition on the map as an image.

[0018] To that end, a two-step retrieval including a qualitativeretrieval and a quantitative retrieval, which will be mentioned, isperformed through an interactive process. Though the operation of imageinformation (for example, map information) having the correspondence toa DB having text information such as attribute information storedtherein, text information corresponding to the image information isretrieved from the DB. In the following, the attribute information isused as the text information.

[0019] 1) The qualitative retrieval includes a DB information readingprocess for reading image information, attribute information andinformation relevant thereto, and a qualitative retrieval process formaking a qualitative retrieval including the partial overlaying of thefirst image information (for example, map information) with anotherimage information related with the first image information for retrievalor a rough retrieval with another information used as a retrieval key toget the result of retrieval and for storing the result of retrieval intoa work file. The retrieval key used in the qualitative retrieval processis called information lens. The qualitative retrieval process selectsinformation from the information read through the DB information readingprocess. The result of selection is stored in the work file. The resultof selection is a partial assembly of the information read through theDB information reading process.

[0020] 2) The quantitative retrieval includes a DB information readingprocess for reading image information, attribute information andinformation relevant thereto, which are stored in the work file, and aquantitative retrieval process for making a quantitative retrieval inwhich the first image information is overlaid with a retrieval keycalled a function sheet including the composition of a quantitativeretrieval condition and an image indicative of a area of application ofthe retrieval condition and for displaying the result of retrieval on adisplay device.

[0021] In the case where the obtained result of retrieval is notpreferable or in the case where another retrieval is made, either aprocessing including the repetition of the qualitative retrieval and thequantitative retrieval subsequent thereto or a processing including therepetition of only the quantitative retrieval can be selected on thebasis of a user's instruction.

[0022] The following processing is performed in the qualitativeretrieval.

[0023] (1) In a DB information reading process, image information andtext information stored in a DB are read and displayed on a displaydevice.

[0024] (2) In a parameter setting process, a retrieval condition for thedisplayed image information is set.

[0025] (3) In an image information composing (or generating) process,another image information necessary for retrieval is displayed in acomposite form with the above-mentioned image information on the basisof an inputted instruction.

[0026] (4) In a DB retrieval process, text information is retrieved fromthe DB on the basis of the retrieval conditions designated in the aboveitems (2) and (3).

[0027] In the present invention, the generation or composition of imageinformation in the above item (3) includes the composition of imageinformation as will be mentioned in the following.

[0028] 1) The other image information including detailed information iscomposed in a local area on the displayed image information.

[0029] 2) A magnified version of another image information includingdetailed information is composed in a local area on the displayed imageinformation.

[0030] 3) Another image information including detailed information iscomposed in a local area on the displayed image information and withinan area which includes a position set by the user.

[0031] 4) By use of the correspondence of the displayed imageinformation to another image information to be composed thereon, amodified version of another image information including detailedinformation is composed and displayed in a local area on the displayedimage information.

[0032] The following processing is performed in the quantitativeretrieval.

[0033] There is generated as image data a function sheet for composingthe designation of an area to be retrieved and a DB retrieval condition.A frame designating the area to be retrieved is generated as the imagedata of the function sheet and is displayed overlaying image data to besubjected to retrieval (or which is an object of retrieval). An areacorresponding to the image data of the function sheet is obtained ordetermined in accordance with a user's operation for the image data ofthe function sheet. A retrieval condition with the determined area takenas the area to be retrieved is generated as text information and the DBis retrieved on the basis of the text information.

[0034] According to the present invention, another image information isdisplayed in a form composed on image information displayed on a screen.With such a construction, it is possible to understanding another imageinformation in an intended area while seeing the state of theenvironment and to retrieve information corresponding to that area froma DB.

[0035] According to the present invention, a retrieval condition and anarea of application thereof are displayed as image data in a compositeform with image information. The displayed image data is operated todetermine a position at which the image data is displayed, that is, aposition on image data which is an object of retrieval. The determinedarea is inputted as a retrieval condition representative of an area tobe retrieved. With such a construction, it is possible for a user toinput the area to be retrieved without referring to text informationrepresentative of the position of the image information being displayed,thereby facilitating the input of the retrieval condition and the areaof application thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Further objects, features and advantages of the present inventionwill become more clear from the following detailed description of aprefered embodiment, described with respect to the accompanying drawing:

[0037]FIG. 1 is a diagram for explaining the outline of processesperformed in the present invention;

[0038]FIG. 2 is a diagram showing the construction of a computer systemfor embodying the present invention;

[0039]FIGS. 3A and 3B are diagrams showing the constructions ofattribute information DB's;

[0040]FIG. 4 is a diagram showing the construction of an imageinformation DB;

[0041]FIG. 5 is a diagram showing the construction of an image-attributelink information DB in which the correspondence of the attributeinformation DB to the image information DB is stored;

[0042]FIG. 6 is a diagram showing the structure of an information lensor a function sheet format table;

[0043]FIG. 7 is a diagram showing the structure of an information lensor an information lens parameter table in which retrieval conditions arestored;

[0044]FIG. 8 is a diagram showing the structure of a table in which dataconcerning hit link points is stored;

[0045]FIG. 9 is a diagram showing the structure of a table in which acorrespondence between the first image information and the second imageinformation;

[0046]FIG. 10 is a flow chart showing a DB information reading process;

[0047]FIG. 11 is a flow chart showing a parameter setting process and animage information generating process;

[0048]FIG. 12 is a flow chart showing a retrieval condition settingprocess;

[0049]FIG. 13 is a flow chart showing a DB retrieval process;

[0050]FIG. 14 shows a displayed example of a retrieval menu and DBinformation;

[0051]FIG. 15 shows a displayed example of a menu in the designation ofthe shape of an information lens;

[0052]FIGS. 16A and 16B show a displayed example of the overlaying ofimage information by a lens;

[0053]FIGS. 17A and 17B show a displayed example of a retrievalcondition setting menu;

[0054]FIG. 18 shows a displayed example of the result of retrieval withlens;

[0055]FIG. 19 shows a displayed example of the overlaying of imageinformation with magnified image information;

[0056]FIGS. 20A and 20B show a displayed example on a screen before andafter the transformation for image positioning;

[0057]FIG. 21 is an enlarged view of an image information portionsubjected to positioning;

[0058]FIG. 22 is a diagram for explaining a modifying process for imagepositioning;

[0059]FIG. 23 is a diagram showing the structure of a function sheetparameter table in which retrieval conditions are stored;

[0060]FIG. 24 is a flow chart of a DB information reading process;

[0061]FIG. 25 is a flow chart of a retrieval process;

[0062]FIG. 26 is a flow chart for the setting of a retrieval condition;

[0063]FIG. 27 is a flow chart of a DB retrieval process;

[0064]FIG. 28 is a displayed example of a menu screen;

[0065]FIG. 29 is an example of a menu for inputting initial values of anarea to be retrieved;

[0066]FIGS. 30A and 30B show a displayed example of a retrievalcondition input screen;

[0067]FIGS. 31A and 31B show a displayed example for the input of a DBretrieval condition;

[0068]FIGS. 32A and 32B show a displayed example of the result ofretrieval;

[0069]FIG. 33 shows a displayed example of the result of retrieval;

[0070]FIGS. 34A and 34B show a displayed example of the result ofretrieval; and

[0071]FIGS. 35A and 35B show a displayed example of the result of DBretrieval using a plurality of function sheets.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0072] Embodiments of the present invention will now be explained indetail by use of the accompanying drawings.

[0073]FIG. 1 is a diagram for explaining the outline of processesperformed in the present invention. In the overall processing shown inFIG. 1, a two-step retrieval including a qualitative retrieval (in aprocess block 800) and a quantitative retrieval (in a process block900), which will be mentioned, is performed through an interactiveprocess so that, through the processing of image information (forexample, map information) having the correspondence to a DB having textinformation such as attribute information stored therein, textinformation corresponding to the map information is retrieved from theDB. In the following, the attribute information is used as the textinformation.

[0074] 1) Qualitative Retrieval: The process block 800 includes a DBinformation reading process 810 and a qualitative retrieval process 805.The DB information reading process 810 includes reading imageinformation, attribute information and information relevant thereto. Thequalitative retrieval process 805 includes making a qualitativeretrieval including the partial overlaying of the second imageinformation related with the firsti mage information for retrieval onthe first image information (or map information) or a rough retrievalwith the second image information used as a retrieval key to get theresult of retrieval, and storing the result of retrieval into a workfile 2 a. The retrieval key used in the qualitative retrieval process805 is called information lens. The details of the information lens willbe mentioned later on. The qualitative retrieval process 805 selectsinformation from the information read through the DB information readingprocess 810. The result of selection is stored in the work file 2 a. Theresult of selection is a partial assembly of the information readthrough the DB information reading process 810.

[0075] 2) Quantitative Retrieval: The process block 900 includes a DBinformation reading process 910 and a quantitative retrieval process920. The DB information reading process 910 includes reading imageinformation, attribute information and information relevant thereto,which are stored in the work file 2 a, that is, various informationselected by the qualitative retrieval. The quantitative retrievalprocess 920 includes making a quantitative retrieval in which the firstimage information is overlaid with a retrieval key called a functionsheet including the composition of a quantitative retrieval conditionand an image indicative of a area of application of the retrievalcondition, and displaying the result of retrieval on a display device.

[0076] In the case where the obtained result of retrieval is notpreferable or in the case where another retrieval is made, either aprocessing (999 a) including the repetition of the qualitative retrieval800 and the quantitative retrieval 900 subsequent thereto or aprocessing (999 b) including the repetition of only the quantitativeretrieval 900 can be selected on the basis of a user's instruction.

[0077]FIG. 2 is a diagram showing the construction of a computer systemfor embodying the present invention.

[0078] A central processing unit (CPU) 1, an external memory (storageunit) 2, an input device 3 and a display device 5 are connected througha system bus 6. Attribute information DB's 100 and 110, an imageinformation DB 200 and a link information DB 300 are stored in theexternal memory 2. The CPU 1 is provided with a memory 4 which stores aprogram for executing the processing shown in FIG. 1 and various tables.The input device 3 includes an indicator represented by a mouse or a peninput device. The work file 2 a shown in FIG. 1 is also stored in theexternal memory 2.

[0079] The qualitative retrieval 800 is composed of the DB informationreading process 810 and the qualitative retrieval process 805. Thequalitative retrieval process 805 includes a parameter setting process820, an image information generating process 830 and a DB retrievalprocess 840.

[0080] In the process 810, a data format of DB retrieval condition isgenerated as a DB retrieval format table 500 a on the basis of theattribute information DB's 100 and 110 in which attribute information isstored. Further, there are read the image information DB 200 in whichimage information is stored, an image-image link information DB 730 inwhich the correspondence between image information is stored and theimage-attribute link information DB 300 in which link information forlinking the image information and the attribute information DB with eachother is stored. The read DB information is displayed on the displaydevice 5.

[0081] In the process 810, image information to provide a reference(hereinafter referred to as first image information) and imageinformation to be composed thereon (hereinafter referred to as secondimage information) are read so that the first image information isstored and displayed and the second image information is only stored andthen fetched in the succeeding image information generating process 830.Usually, the first image information is predetermined. However, in thecase where the retrieval condition is complicated, a plurality-kind ofsecond information may be read beforehand.

[0082] In a coordinate data table 400 is stored the more detailedcorrespondence of individual image information to each record of the DB.The coordinate data table 400 is linked with a part of the field of theDB 300. The details of the tables will be explained later on.

[0083] In the process 820, initial values concerning the informationlens are set by an input from the input device 3 by a user and/or asetting values obtained from the table 500 a generated in the process810, values prepared beforehand by the system and the preceding usedvalue, and an information lens parameter table 600 a is generated by useof the inputted initial values, thereby setting parameters.

[0084] The information lens in the present invention includes thecomposition of a table of various parameters which represents a displaymethod, a retrieval method and a display method of the result ofretrieval and image data which represents an area to be displayed and anarea to be subjected to retrieval. Image information in the display areaof the information lens is called image information in lens area. Anarea to be displayed is called lens area and an area to be retrieved iscalled focus area.

[0085] The information lens has a lens area in which the first imageinformation is displayed in a form overlaid with a part of secondinformation a focus and a focus area which indicates an object ofretrieval of attribute information from the DB. In the case where thefirst image information is to be displayed in the form overlaid with thepart of the second image information, the second image information isdisplayed in a form modified so that the correspondence thereof to thefirst image information is recognizable. With the overlay of the part ofthe second image information, a limited area of the first imageinformation is displayed with information detailed more than itsenvirons, thereby providing a function such as an information lens ormagnifying lens for the first image information. In the case where theattribute information of DB is to be retrieved, a point a point in theimage information having a correspondence to the attribute informationis searched in the focus area and the DB retrieval is made by use of thecorrespondence to the first image information so that the result ofretrieval is displayed on the displayed information by use of charactersor graphics.

[0086] In the process 830, image information to be displayed on thedisplay device 5 is generated referring to the information lensparameter table 600 a generated in the process 820 and the generatedimage information is displayed in a composite form with imageinformation which has already been displayed on the display device 5.

[0087] In the process 840, the DB retrieval is made on the basis of theinformation lens parameter table 600 a generated in the process 820 andwith reference to the DB 100, the DB 200, the DB 300, the table 400 andthe DB 730. Further, the result of retrieval is stored into a hit linktable 700 and the image data of the information lens and the result ofretrieval are displayed.

[0088] The correspondence of the processes 810, 820, 830 and 840 to theflow charts of FIGS. 10 to 13 is indicated in the blocks of FIG. 1.

[0089]FIGS. 3A and 3B show the attribute information DB's 100 and 110stored in the external memory 2. In the present embodiment, the DB 100and the DB 110 are considered as the attribute information DB's. One DBor three or more DB's may be used. Also, in the case where a pluralityof image information DB's and a plurality of attribute information DB'sare linked in various combinations, the combination of image informationto be first displayed and an attribute information DB is determined by auser in the DB information reading process 810 and the combination ofthe image information and the attribute information DB is changed in theparameter setting process 820 in accordance with the situation ofretrieval.

[0090] According to the present embodiment, in the case where aplurality of DB's are used, the plurality of DB's can be refered througha kind of image information.

[0091] As shown in FIG. 3A, the attribute information DB 100 includesthe columns of DB number 101, record number 102, attribute number 103,full name 104, sex of subscribers 105, address 106 and birth data 107.The DB number 101 is a number peculiar to each DB. The DB number may becode data representative of the name of each DB if it is a unique numberto the DB. The record number 102 is a consecutive number fordistinguishing records in the DB from each other and may serve for theattribute number 103, too. Each of the columns 104 to 107 includesattribute information data of attributes adapted for the contents ofthat item. For example, a character string is stored in the column 104and the value of 0 or 1 is stored in the column 105.

[0092] As shown in FIG. 3B, the attribute information DB 110 includesthe columns of DB number 111, record number 112, attribute number 113,name of householder 114, address 115, site area 116 and name oflandowner 117. Since each column is fundamentally similar to that in theDB 100, the detailed explanation thereof will be omitted. It does notnecessarily follow that the item of each of the columns 113 to 117 isthe same in the respective attribute information DB's.

[0093]FIG. 4 shows the table structure of the image information DB 200and an image data storage table 210. In the present embodiment, a map isused as one example of image data. Maps represented by image data (orimage maps) are stored in the columns 211, 212, 213, 214, - - - of thetable 210. In the case where there is a positional relation betweenimage information of the image maps, the image information is managed bydefining an origin for the image data to be displayed and moving each ofthe image information on the basis of the origin in order to representthe positional relation. The origin is defined in a coordinate system.This coordinate system is called absolute coordinate system andcoordinates in the absolute coordinate system are called absolutecoordinates.

[0094] The image information DB 200 includes the columns of image number210, image name 202, type of image information 203, X and Y coordinates204 and 205 of the absolute coordinates of the origin of the image,leading address 206 of the image information storage table. The imagenumber is a number for distinguishing each image information uniquely.The image name represents the contents of the image by a characterstring. The type of image information is data representative of the typeor kind. For example, in the case where image information is a map, thetype of image information is a map or the like represented byresidential map, topographic map and aerial photograph. The type ofimage information includes the scale and accuracy of the map. In thecase where image information is a blueprint, the type of imageinformation is data representative of the type of the blueprint such asfront view, side view, layout, sketch drawing and cross section. Namely,the image name and the type of image information are information whichprovides marks of representation of the contents of the image by code ortext information.

[0095] Though not shown, image information representing the contents ofeach image information may be prepared separately. Such imageinformation includes, for example, image information reduced to anextent in which the outline of the image information is recognizable,the version of representation of image information photographed by acamera or television camera, or a handwritten drawing.

[0096]FIG. 5 shows the table structure of the link information DB 300 inwhich link information representing the correspondence of the firstimage information to text information or attribute information is storedand the coordinate data table 400 which represents the more detailedcorrespondence.

[0097] Link information representing the correspondence of imageinformation to text information includes primary link information andsecondary link information. The primary link information includes thecombination of the record number of each record of DB and coordinatedata representative of an object in image information corresponding tothat record and is stored in the table 400. An assembly including atleast one primary link information is called secondary link information,and link information concerning the secondary link information is storedin the DB 300.

[0098] The secondary link information is composed of link attribute, thename of a creator of link information, creation date and identifierwhich are stored in the columns 301 to 310 of the DB 300. The linkattribute 301 includes link definition 302 and predetermined process303. The identifier 306 includes a DB number 307, an image number 308, aleading address 309 of the table 400 in which the primary linkinformation forming the secondary link information is stored, the number310 of primary link information. The predetermined process is aprocessing for performing a predetermined process in accordance with aninput for information indicated by the identifier. For example, thepredetermined process, in the case where attribute information ischanged, is a process for correcting image information with acorrespondence to the changed attribute information in accordance with apredetermined method.

[0099] Though an origin 1001 of image information 1000 is represented inthe absolute coordinate system of the image information DB, as hasalready been mentioned, the coordinates in the table 400 are representedin terms of a coordinate system for each image (or relative coordinatesystem). Each object in image information is generally represented by aplurality of coordinates but may be represented by a representativepoint 1002 or 1003 provided in that object.

[0100] The provision of a representative point representing an object,as shown in FIG. 5, reduces a retrieval throughput at the time ofretrieval of primary link information from an area to be retrieved,thereby enabling more rapid retrieval.

[0101]FIG. 6 shows the structure of the DB retrieval format table 500 a.The table 500 a includes the columns of item number 501 fordistinguishing the item of a retrieval condition, content of item 502and attribute of item 503. The contents of the attribute informationDB's 100 and 110 are copied into those columns with the reference beingmade to the DB's.

[0102]FIG. 7 shows the structure of the information lens parameter table600 a, a retrieval item table 620 a and an image data storage table 630a.

[0103] The table 600 a includes the columns of lens number 601 apeculiar to each information lens, origin of lens 602 a which is theorigin of a position representing the information lens, shape of lens605 a, size of lens area 606 a, size of focus area 607 a, magnifyingrate 608 a, leading address 609 a of the retrieval item table 620 a inwhich retrieval items are stored, display style 610 a of the result ofretrieval and image data 611 a of the information lens. The lens areaand the focus area of the information lens can be determined byproviding the columns of X and Y coordinates 603 a and 604 a of anorigin determinative of a position on image information in the column602 a of origin of lens, providing the focus area and the lens area withsimilar figures and predetermining a positional relation between thefocus area and the lens area.

[0104] In the present embodiment, examples of the shape of theinformation lens include rectangle, circle and polygon. However, aregion enclosed by a free curve or a specified shape beforehandregistered may be used in accordance with image information to besubjected to retrieval. For example, in the case where a map is used asimage information, a figure can be used which represents administrativedistricts or an area along a certain road. Since the shape of the lenscan thus be changed in accordance with the object of retrieval, analysisadapted for the property of an area becomes possible.

[0105] The retrieval item table 620 a includes the columns of lensnumber 621 a, item number 622 a, item 623 a, attribute 624 a, set value625 a and display flag 626 a of the result of retrieval. The image datastorage table 630 a may be integrated into the information lensparameter table 600 a. However, when considering the fact that the table600 a includes text or code information, it is preferable that the table630 a is provided in a separate storage area as in the presentembodiment.

[0106]FIG. 8 shows the structure of the hit link tale 700. The table 700includes the columns of DB number 701, record number 702, image number703, coordinate 704 and leading address 705 of a retrieval result table710 in which the results of retrieval are stored. The table 710 includesthe columns of sheet number 711 and retrieval result flag 714. The sheetnumber column 711 is used when the retrieval with function sheet whichwill be mentioned later on. The column 711 is provided with the numberequal to the number of function sheets generated.

[0107]FIG. 9 shows the structure of a correspondent point setting tablestored in the image-image link information DB 730. The table 730includes the columns of consecutive number 731 peculiar to a pair ofcorrespondent points, coordinates 732 of correspondent point on firstimage information indicating the pair of correspondent points, andcoordinates 733 of correspondent point on second image informationcorresponding to the coordinates 732.

[0108] A quantitative retrieval with information lens will be explainedalong the following procedure.

[0109] First, the DB information reading process 810 shown in FIG. 1will be explained using FIG. 10 in reference to a displayed exampleshown in FIG. 14. Next, the parameter setting process 820 and the imageinformation generating process 830 will be explained using FIG. 11 inreference to displayed examples shown in FIGS. 15 and 16. Further, aretrieval condition setting process as a part of the parameter settingprocess 820 will be explained using FIG. 12 in reference to a displayedexample shown in FIG. 17. Finally, the DB retrieval process 840 will beexplained using FIG. 13 and a displayed example of the result ofretrieval will be shown in FIG. 18.

[0110]FIG. 10 shows a flow chart of the DB information reading process810.

[0111] When the system is started, the contents of the columns of theimage name 202 and type of image 203 in the image information DB 200 aredisplayed as map menus on the display device 5 (step 8010). When the mapname of a map to be subjected to retrieval is inputted by the inputdevice (step 8015), the corresponding image data is read from the imageinformation DB 200 and is displayed on the display device 5 (step 8020).At this time or simultaneously, the image number is read.

[0112] In the present embodiment, only the map name is inputted.However, if one can be specified from various maps, an image numberassociated with a map to be subjected to retrieval may be inputted whenthe map is designated by the selection of a reduced image, the selectionof a schematically represented menu, and so forth.

[0113] Next or when the name of a DB to be subjected to retrieval isinputted by the input device 3 (step 8025), the DB number 101 or 111 ofa DB corresponding to the inputted DB name is read from the attributeinformation DB. On the basis of the image number (or map name) and theDB number is read link information of the link information DB 300 (step8030). And, a DB retrieval format table 500 a is generated referring toitems of the attribute information DB and the attributes of the items(step 8035).

[0114] As has been mentioned above the format for DB retrieval isgenerated referring to the attribute information DB. Therefore, a usercan set a retrieval item even if the user does not know the contents ofthe attribute information DB beforehand.

[0115] A menu for retrieval and the read DB information are displayed onthe display device 5 and there turns into a waiting condition untilthere is an input from the user (step 8040). An example of the displayscreen at this time is shown in FIG. 14. As shown in FIG. 14, the menuincludes a menu 1010 for designating a map and a DB to be subjected toretrieval and a menu 1013 for making a retrieval with information lens.The menu 1013 includes the areas of “GENERATE” 1014 a, “CONDITION” 1015a and “END” 1016. When each area is selected, the corresponding mode isset.

[0116] The menu 1010 shown in FIG. 14 includes an area 1011 fordesignating a map to be subjected to retrieval and an area 1012 fordesignating an attribute information DB to which the reference is to bemade. While seeing a reduced map displayed in the area 1011, the usercan select the corresponding DB from the DB's displayed in the area1012. The menu 1013 includes an area 1014 a for indicating the start ofretrieval using an information lens, an area 1015 a for indicating thesetting or change of a retrieval condition, and an area 1016 forindicating the end of the system.

[0117] The selection of an area in the menu is realized by moving anarea designating input mark or a cursor 1017 into the area and inputtingan instruction for area selection by an input device such as mouse. Anarea to be selected is called button. In the following, the selection ofan area is expressed as selecting a button in order to make adistinction from the depression of a button of an input device.

[0118] An area 1018 is an area for displaying image information or DBinformation.

[0119] Next, the parameter setting process 820 will be explained usingFIG. 11.

[0120] After the menu and the DB information have been displayed, asshown in FIG. 14, the judgement is made as to whether or not the menu1010 is selected (step 8045). The flow returns to step 8010 if the menuis selected and proceeds to step 8050 if the menu is not selected.

[0121] In step 8050, the judgement is made as to whether or not thebutton 1016 is selected. If the button 1016 is selected, the processingis completed. If the button 1016 is not selected, the flow proceeds tostep 8055.

[0122] In step 8055, the judgement is made as to whether or not thebutton 1014 a or 1015 a is selected. If the button 1015 a is selected, aretrieval condition setting/changing mode is set or the flow branches tostep 8060 to perform the processings of steps 8060, 8065 and 8070 andthe flow then proceeds to step 8080. If the button 1014 a is selected, aretrieval mode is set or the flow goes to step 8075. If neither thebutton 1014 a nor 1015 a is selected, the flow goes to step 8078.

[0123] In step 8060, a condition setting mode is first set. Next, in thecase where the tables 600 a and 620 a have not been generated, thetables 600 a and 620 a are generated and a lens number of the column 601a is set while a menu 1020 for designating the shape of an informationlens, as shown in FIG. 15, is displayed on the menu 1013. In the casewhere anyone in the menu 1020 is selected or after a fixed time has beenelapsed after the display of the menu 1020, the former display shown inFIG. 14 is restored. The menu 1020 includes a plurality of areas fordesignating the shape. For example, areas 1021, 1022 and 1023 are menusfor designating a rectangular area, a circular area and a freely setarea, respectively, as the shape of an area to be retrieved.

[0124] In the case where the tables 600 a and 620 a have been generated,there turns into a condition of waiting for the selection of aninformation lens to be subjected to the change of the retrievalcondition. At this time, the display urging the user to select may bemade in such a manner that information lenses selectable by the user aredisplayed with different colors, as shown by shaded portions 11036 a and11036 b in FIG. 16B.

[0125] In step 8065, image data of the information lens is generatedreferring to the parameter table 600 a generated in step 8060 and isdisplayed. Further, a retrieval condition settlement button 1031 and acondition setting/changing button 1032 (see FIG. 16A) are displayed onthe menu 1013. The retrieval condition settlement button 1031 and thecondition setting/changing button 1032 will be explained in conjunctionwith step 8070.

[0126] The information lens is displayed by circles 1033 a and 1035 aand a semicircle 1034 a shown in FIG. 16A. Reference numeral 1033denotes a lens area, numeral 1035 a focus area, and numeral 1034 aretrieval condition setting/changing button. The function of the button1034 is similar to that of the button 1032.

[0127] In step 8070, a retrieval condition is inputted from the inputdevice 3 and parameters are set into the parameter table 600 a. Thedetails of step 8070 will be explained using FIG. 12.

[0128] When the button 1032 or 1034 shown in FIG. 16A is selected, anwindow 1040 a for DB retrieval condition setting, as shown in FIG. 17A,is displayed on the display device 5 (step 80701). This window isgenerated referring to the table 620 a. In step 80702, a display style,a set value for a retrieval item and an instruction for whether or notthe result of retrieval for the retrieval item should be displayed areinputted from the input device 3. The input of those values is accepteduntil the settlement menu 1031 is selected. In the case where thesettlement menu 1031 is selected (step 80703), the display of the window1040 a is erased and the inputted parameters are stored into the tables600 a and 620 a (step 80704).

[0129] An example of the window 1040 a will now be explained briefly byuse of FIG. 17B. The window 1040 a is composed of input areas 1041 and1042 of display style, input areas 1043 to 1047 for set values forretrieval items, and areas 1048 to 1052 for setting the presence/absenceof display of the retrieval results for the retrieval items 1043 to1047.

[0130] When the settlement menu 1031 is selected, the set conditions arestored into the tables 600 a and 620 a (step 80704) and the informationlens is displayed on the display device 5 (step 80705).

[0131] As has been mentioned above, the values of the table 600 a areset or changed. At this time, in the case where there are a plurality ofimage information read in the process 810, image information made anobject of determination of the focus area is set.

[0132] On the other hand, in the case where the result of judgement instep 8055 shows that the menu or button 1014 a is selected, apredetermined value is set into the table 600 a if one information lensis not set in the table 600 a, and an information lens is displayed onthe basis of the set value (step 8075). Further, image information madean object of determination of the focus area is set. In the case whereneither the menu 1014 a nor the menu 1015 a is selected, the judgementis made as to whether or not there is the input of movement ormodification for the information lens (step 8078). If there is theinput, the flow proceeds to step 8080. If there is no input, the flowreturns to step 8040.

[0133] With the above processing, the information lens is displayed andthe flow proceeds to step 8080. In step 8080, the positions of the lensarea and the focus area are detected and these areas are determined andare stored into the table 600 a. If a relation between the lens area andthe focus area is defined beforehand, the storage of the origin and areaof the lens area and the size of the focus area suffices.

[0134] Next, the image information generating process 830 is performedin steps 8085 and 8090 so that image information to be displayed in thelens area is generated and displayed on the display device 5.

[0135] The second image information read in the process 810 is modifiedon the basis of the parameter concerning the lens area and themagnifying rate which are stored in the parameter table 600 a and thecorrespondence of the first image information to the second imageinformation which is stored in the image-image link information DB 730,so that image information in the lens area is generated. The modifyingprocess will be explained later on.

[0136] In step 8090, an image generated in step 8085 is displayed on thedisplay device in a composite form with the corresponding portion of thefirst image information. Since the overlaying or overlapping display ofa plurality of image information can be realized by the prior art, theexplanation thereof will be omitted.

[0137] A displayed example of first image information composed withsecond image information in a lens area is shown in FIG. 18. The firstimage information is displayed in the display area 1018 and the secondimage information or image information in lens area is displayed in thearea 1033 a in a composite form with the first image information.Displayed contents 1071 a to 1077 a are image information generated onthe basis of the second image information.

[0138] The process for modifying the second image information will beexplained using FIGS. 19 to 22. The modifying process the two followingprocesses:

[0139] (1) a “magnifying process” available in the case where a usergrazes steadily at an overlaying area or in the case where a pluralityof DB's have a correspondence to one image information; and

[0140] (2) a “transforming process” available in the case where thedeviation of image information is caused, as shown in FIG. 20A, when aplurality of image information are overlaid on the basis of the originof image information stored in the image information DB 200.

[0141] In the magnifying process, image information in lens area isgenerated in a version magnified on the basis of the magnifying rate ofthe table 600 a. The magnifying rate is set to 1 beforehand. In the casewhere the image information in lens area is to be generated by themagnifying process, a magnifying rate is set in step 8070. A displayedexample of image information subjected to the magnifying process isshown in FIG. 19. Marks 1068 a and 1069 a indicate that a correspondenceis made to different DB's.

[0142] In overlaying the first image information with the second imageinformation, the display area and display style (ormagnification/reduction) of the second image information can be setarbitrarily on the basis of the user's instruction, as mentioned above.Therefore, the present invention provides the following effects.

[0143] (a) Since an area overlaid with the second image information islimited to only a necessary portion of the first image information, itis possible to prevent the overlaying of image information from causingthe increase of in amount of the displayed information in the whole ofthe same area, which increase is caused in the prior art. As a result,it is possible to avoid a problem that, due to the excess of informationor the overlaying of characters or symbols on a map, the user may take aconsiderable time for searching for necessary information or mayoverlook the necessary information.

[0144] (b) Since there is always displayed the whole of the first imageinformation which the second image information is to overlay, the usercan designate precisely an area to be overlaid with the second imageinformation while seeing the first image information.

[0145] On the other hand, the transforming process available in the casewhere first image information and second image information are displayedoverlaying with a deviation from each other, as shown in FIG. 20A, isperformed for displaying both the image information with a matchingcorrespondence of image information to each other, as shown in FIG. 20B.

[0146] In FIGS. 20A and 20B and FIG. 21, the coordinates 732 and 733 ofcorrespondent points of first and second image information stored in theimage-image link DB 730 are indicated by white and black dots,respectively. The transformation of the second image information willnow be explained using FIG. 21.

[0147] There are selected three (for example, correspondent points 2105,2106 and 2107) from among correspondent points of the first imageinformation included in the lens area (hereinafter referred to ascorrespondent points on first image information), and the reference ismade to the image-image link information DB 730 to determinecorrespondent points 2101, 2103 and 2102 of the second image information(hereinafter referred to as correspondent points on second imageinformation) which correspond to the selected correspondent points. Suchtwo sets of combinations of three points are selected and the secondimage information is modified in accordance with an algorithm which willbe mentioned later on. A method of selecting correspondent points fromthe first image information includes a method in which a user designatesthe correspondent points through the input device 3 and a method inwhich those of correspondent points nearer to the centroid of the lensarea are selected.

[0148] An example of an algorithm for transformation of overlaying imageinformation will now be described. In the described transformation, atriangle formed by a set of three correspondent points on the secondimage information is transformed to coincide with a triangle formed bycorrespondent points on the first image information corresponding to thethree points in the set. For example, in FIG. 21, a triangle formed bycorrespondent points 2101, 2103 and 2102 on the second image informationis transformed to coincide with a triangle formed by correspondentpoints 2105, 2106 and 2107 on the first image information.

[0149] Computational expression for transformation will now be shown. Asshown FIG. 22, it is assumed that correspondent points on the firstimage information are A(Xa, Ya), B(Xb, Yb) and C(Xc, Yc) andcorrespondent points on the second image information are A′(Xa′, Ya′),B′(Xb′, Yb′) and C′(Xc′, Yc′). At this time, the correspondent pointsA′, B′ and C′ on the second image information are corrected to coincidewith the correspondent points A, B and C on the first image information.As a result, any point D′(Xd′, Yd′) included in the triangle A′B′C′formed by the correspondent points on the second image information iscorrected to turn into a point D(Xd, Yd) calculated by the followingequations:

Xd=T(Xb−Xa)+S(Xc−Xa),

Yd=T(Yb−Ya)+S(Yc−Ya)  (1)

[0150] where

[0151] T=(s2*Xd′−s1*Yd′)/(t1*s2−t2*s1)

[0152] S=(t2*Xd′−t1*Yd′)/(t2*s1−t1*s2)

[0153] t1=Xb′−Xa′

[0154] t2=Xc′−Xa′

[0155] s1=Yb′−Ya′

[0156] s2=Yc′−Ya′.

[0157] Besides the above method, the conventional two-dimensionalgraphic transformation method can be used. With the use of theabove-mentioned transforming process, the following effects areobtained.

[0158] (1) Since a mismatching between two image information is reduced,useless information in the overlaying areas is reduced, thereby reducinga user's misperception.

[0159] (2) Since a correspondence between two image information isvisually represented, the user can make a rapid judgement based thereon.

[0160] Finally, the DB retrieval process 840 will be explained usingFIG. 13.

[0161] In the DB retrieval process 840, a search for primary linkinformation included in a focus area determined in step 8080 shown inFIG. 11 is made using the link information DB 300 and the searched-outprimary link information is stored into the hit link table 700 (step8095). The focus area is an area corresponding to first imageinformation or second image information set in step 8065 or 8075 shownin FIG. 11.

[0162] The DB retrieval is made for the primary link informationdetermined in step 8095 on the basis of the attribute information DB's100 and 110 and a DB retrieval condition stored in the table 620 a (step80100). In the present embodiment, the DB retrieval is made after theretrieval of an area. However, in the case where the number of primarylink information is great, the abstraction of primary link informationmay be made after the DB retrieval.

[0163] As the result of DB retrieval, a flag is set into the column 705of the table 700 for the corresponding primary link information (step80105) and the primary link information having a set flag in the column705 is displayed (step 80110). Marks 1061 a to 1067 a shown in FIG. 18are link information concerning the primary link having a set flag inthe column 705.

[0164] Information of the attribute information DB concerning theprimary link information having a set flag in the column 705 is readreferring to the columns 701 and 702 (step 80115). Referring to thedisplay style 610 a of the table 600 a and the flag 626 a of the table620 a indicating whether or not the result of DB retrieval should bedisplayed, data for display of the result of DB retrieval is generatedfrom the read DB information (step 80120). The generated data isdisplayed on the display device 5 (step 80125).

[0165] A displayed example of the result of DB retrieval is shown inFIG. 18. The result of DB retrieval is displayed in an area 1081. Asshown in FIG. 18, values set in step 80702 of FIG. 12 are such that afull name and an address are displayed as the result of DB retrieval andthe display style is a style of displaying a display area in a card formfor the corresponding primary link information. As another display stylemay be used a method in which the result of DB retrieval is displayed inone table. In this case, the area 1041 shown in FIG. 17B is selected.The area 1081 for displaying the result of retrieval is set at theperiphery of the lens area 1033 a so that individual results ofretrieval do not overlap, and the display is made so that a connectionwith the corresponding marks 1061 a to 1067 a is recognizable.

[0166] Also, the result of retrieval and relevant information such asimage information as shown in FIG. 18 are stored into the work file 2 a.Namely, each information stored in the external memory 2 is selectivelystored into the work file 2 a through the above-mentioned qualitativeretrieval and is then used in the quantitative retrieval with functionsheet which will be mentioned later on.

[0167] In the present invention, the correspondence of the result of DBretrieval to a position on a map corresponding thereto is displayed, asmentioned above. Therefore, even if information for an individualportion is displayed, there is no fear that a user may lose sight of thecorrespondence.

[0168] The quantitative retrieval 900 with function sheet shown in FIG.1 is composed of the DB information reading process 910 and thequantitative retrieval process 920. In the quantitative retrieval 900which will be mentioned in the following, the work file 2 a generated inthe qualitative retrieval 800 is used. The contents of the work file 2 aare substantially the same as the contents stored in the external memory2. Therefore, the same reference numerals as those used in conjunctionwith the external memory 2 will be used.

[0169] In the process 910, a data format of DB retrieval condition isgenerated as a DB retrieval format table 500 b on the basis of theattribute information DB's 100 and 110 in which attribute information isstored. The process 910 further includes reading, from the work file 2a, the image information DB 200 in which image information is stored andthe link information DB 300 in which link information for linking theimage information and the attribute information DB with each other isstored. The read DB information is displayed on the display device 5.

[0170] The process 920 includes a function sheet generating instructiondetecting process 921, a retrieval condition changing instructiondetecting process 922, a function sheet generating/changing process 923and a DB retrieval process 914. A function sheet in the presentinvention is the composition of image data designating an area to beretrieved for image information and a retrieval condition represented bytext information. Namely, the text information included in the functionsheet qualitatively sets a retrieval condition, and the image dataincluded therein directly sets an area of application of the retrievalcondition on image information which is an object of retrieval. Theimage data includes image data which is used for only the designation ofan area to be retrieved and image data in which a retrieval conditionrepresented by text information is converted into an image and isdisplayed in a composite form.

[0171] The retrieval condition represented by text information includesa locational requirement, a DB requirement and a combinativerequirement. The locational requirement is text information concerningan area to be retrieved which is inputted by operating image data. TheDB requirement is text information concerning a retrieval conditionwhich is used in making the DB retrieval. The combinative requirement istext information which, when the retrieval is made using a plurality offunction sheets, indicates in what relation a locational requirement anda DB requirement possessed by a certain function sheet should beretrieved with a locational requirement and a DB requirement possessedby which of function sheets. The locational requirement may be inputteddirectly by text information from the input device 3.

[0172] Thus, a positional retrieval condition can be inputted byoperating image information displayed on the display device 5.Therefore, it is possible to input an area to be retrieved withoutreferring to text information representative of the position of imageinformation being displayed, thereby facilitating the input of thepositional retrieval condition.

[0173] In the process 920, the contents of a function sheet generatinginstruction or a retrieval condition changing instruction, when theinstruction is inputted, are detected by the process 921 and the process922 and the process 923 is performed. In the process 923, initial valuesconcerning a function sheet are inputted by an input from the inputdevice 3 by a user, the reference to the table 500 b and the setting ofa beforehand prepared value or the preceding used value, and a functionsheet parameter table 600 b is generated by use of the inputted initialvalues. And, image data of the function sheet is generated on the basisof the table 600 b and is displayed in a composite form with imageinformation to be subjected to retrieval. A locational requirement isinputted by operating the image data of the function sheet and is storedinto the table 600 b.

[0174] Thus, the preceding set value can be set as an initial value inthe generation of a function sheet. Therefore, in the case where a partof a retrieval condition is to be changed, a condition setting time canbe shortened. As a result, a retrieval time is shortened so that aneffective retrieval is made.

[0175] In the process 924, the DB retrieval is made on the basis of thetable 600 b generated in the process 923 and with reference to the DB100, the DB 110, the DB 200 and the DB 300. Further, the result ofretrieval is stored into the hit link table 700 and the image data ofthe function sheet and the result of retrieval are displayed.

[0176] The correspondence of the process 910, the process 920 andprocesses 921 to 924 to flow charts shown in FIGS. 24 to 27 is asfollows. Namely, FIGS. 24 and 25 show the flow of the overall processingof the qualitative retrieval 900 as a whole. The details of the process910 are shown in FIG. 24 and the details of the process 920 are shown inFIG. 25. The processes 921 and 922 included in the process 920correspond to step 9055 shown in FIG. 25, the process 923 corresponds tosteps 9060 to 9075, and the process 924 corresponds to step 9080.Further, the details of step 9075 of FIG. 25 are shown in FIG. 26 andthe details of the process 924 are shown in FIG. 27.

[0177]FIG. 23 shows the structure of the function sheet parameter table600 b.

[0178] The table 600 b shown in FIG. 23 includes the columns of sheetnumber 601 b peculiar to a function sheet, origin of the function sheet(reference point of the function sheet area) 602 b, shape of sheet 605b, size of sheet 606 b, leading address 609 b of a retrieval item table620 b in which retrieval items are stored, display style 610 b of theresult of retrieval, leading address 611 b of a sheet image data table630 b in which image data of the function sheet is stored, andcombinative requirement 612 b representing the relation of a DBrequirement possessed by each function sheet. The column of origin ofsheet 602 b is composed of the columns of X and Y coordinates 603 b and604 b of the origin. The column of size of sheet 606 b is composed of,for example, columns representing the lengths of height 607 b and width608 b, respectively. The column of combinative requirement 612 b shows apointer (or partner in operation) and is composed of a sheet numbercolumn 613 b in which the sheet number of a function sheet for linkingretrieval conditions is stored and an operator column 614 b in which anoperator for those conditions is stored. A retrieval conditionrepresented by characters and an area indicating an area of applicationof the retrieval condition are generated as image data of the functionsheet on the basis of the parameters set in the table 600 b and thegenerated image data is displayed on the original image information.

[0179] In the present embodiment, examples of the shape of a functionsheet include rectangle, circle and polygon. However, a region enclosedby a free curve or a specified shape beforehand registered may be usedin accordance with image information to be subjected to retrieval. Forexample, in the case where a map is used as image information, a figurecan be used which represents administrative districts or an area along acertain road. Since the shape of the sheet can thus be changed inaccordance with the object of retrieval, analysis adapted for theproperty of an area becomes possible.

[0180] The table 620 b includes the columns of sheet number 621 b, itemnumber 622 b, item 623 b, attribute 624 b, set value 625 b and displayflag 626 b of the result of retrieval. The table 630 b includes thecolumns of sheet number 631 b, image data 632 b for setting, and imagedata 633 b after composition with retrieval condition.

[0181] A quantitative retrieval with function sheet will be explainedalong the following procedure.

[0182] First, the process 910 shown in FIG. 1 will be explained usingFIG. 24 in reference to a displayed example shown in FIG. 28. Next, thequantitative retrieval process 920 will be explained using FIG. 25 inreference to displayed examples shown in FIGS. 29 and 30. Further, thefunction sheet generating/changing process 923 will be explained usingFIG. 26 in reference to displayed examples shown in FIGS. 30 and 31. TheDB retrieval process 924 will be explained using FIG. 27 and displayedexamples of the result of retrieval will be shown in FIGS. 32, 33 and34. Finally, the result of retrieval, in the case where a plurality offunction sheets are used, will be explained referring to a displayedexample shown in FIG. 35.

[0183]FIG. 24 shows a flow chart of the DB information reading process910. Since steps 9010 to 9035 shown in FIG. 24 are similar to steps 8010to 8035 shown in FIG. 10 except that necessary information such as imagedata and attribute information DB is read from the work file 2 a, theexplanation thereof will be omitted. In step 9040, a menu for retrievaland read DB information are displayed as in step 8040 shown in FIG. 10.However, the display screen in this case has some difference from thatshown in FIG. 14. As shown in FIG. 28, a menu 1013 for retrieval withfunction sheet includes an area 1014 b for indicating the generation ofa function sheet, an area 1015 b for indicating the change of aretrieval condition, and an area 1016 for indicating the end of thesystem. The remaining is similar to FIG. 14.

[0184] After the menu and the DB information as shown in FIG. 28 havebeen displayed, there turns into a waiting condition until there is aninput from the user, and the judgement is made as to whether or not the“END” button 1016 is selected (step 9045). In the case where the “END”button is selected, the processing is completed. In the case where the“END” button is not selected, the judgement is made as to whether or nota menu 1010 for changing a DB to be subjected to retrieval is selected(step 9050). In the case where the menu 1010 is selected, the flowreturns to step 9010. In the case where the menu 1010 is not selected,the quantitative retrieval process 920 shown in FIG. 25 is performed.

[0185]FIG. 25 is a flow chart of the quantitative retrieval process 920.

[0186] First or subsequent to step 9050 shown in FIG. 24, the contentsof a selected menu are judged (step 9055). In the case where theselected menu is “GENERATE” 1014 b, step 9060 is performed. In the casewhere the selected menu is “CHANGE” 1015 b, step 9065 is performed. Afunction sheet generating process will first be explained and aretrieval condition changing process will thereafter be explained.

[0187] In the case where a function sheet is to be generated, presetvalues or values inputted from the input device 3 are set as initialvalues of the function sheet into the table 600 b shown in FIG. 23. Asthe initial values of the function sheet are set values which arecapable of being displayed in an area 1018 shown in FIG. 28. As aresult, the size of displayed image data for setting can be preventedfrom being too large or too small for the area 1018 to display an objectof retrieval. Therefore, no need to change a display magnification ofthe object of retrieval is required until an area to be retrieved issettled. When the menu 1014 b is selected in step 9055, function sheetparameter tables 600 b and 620 b are generated so that a sheet number isset into the column 601 b of the table. Further, a menu 1020 fordesignating the shape of the function sheet, as shown in FIG. 29, isdisplayed on the menu 1013. The displayed menu 1020 includes a pluralityof areas for designating the shape of the function sheet. In FIG. 29,the menu for designating the shape of an area to be retrieved includes arectangular area 1021, a circular area 1022 and a freely set area 1023.

[0188] One of the menus 1021 to 1023 is selected through the operationof a cursor 1017 by the user and is stored as a parameter representativeof the shape into the column 605 b of the table 600 b. Beforehandprepared values are set into the columns 602 b, 606 b and 610 b, and aleading address of the table 620 b is set into the column 609 b. Also,values are set into the columns 622 b to 624 b of the table 620 b on thebasis of the DB retrieval format table 500 b (step 9060). A valuecorresponding to the subtraction of “1” from the sheet number of thecolumn 601 b is stored as a beforehand prepared value into the column613 b and an operator OR is stored into the column 614 b. Then, the flowproceeds to step 9070. In the combinative requirement 612 b shown inFIG. 23, “0” is set into the column 613 b for storage of a sheet numberof partner in operation since the leading sheet number 1 has nopreceding sheet which serves as the pointer. And, “OR” is set as anoperator into the column 614 b. There results in “0.OR.1=1”, that is, itis represented that the comparative requirement is the function sheet 1itself. A function sheet 2 shows that a logical product (AND) with thesheet 1 is made. For function sheets 3, 4, etc., “−1” and “NULL” are setas a sheet number of the pointer and an operator, respectively, therebyrepresenting that a comparative requirement is not yet set. In the casewhere several operations by using of sheets are defined, the sets ofoperations of sheets can be stored in the table 600 b in such a mannerthat a delimiter (0 in FIG. 23) is set in the clumn 613 b of a functionsheet stored in the lead of each set of operations.

[0189] In step 9070, image data of the function sheet is generatedreferring to the function sheet parameter table 600 b generated in step9060, and the generated image data is displayed in a composite form withthe image data of the object of retrieval displayed in the DB displayarea 1018, as shown in FIG. 30A. Further, as shown in FIG. 30A, asettlement menu 1031 and a menu 1032 for indicating the start of settingof a DB retrieval condition are displayed on the menu 1013. The imagedata of the function sheet used in step 9070 is image data displayed ininputting a locational requirement and is called image data for setting.On the other hand, there is image data used when the settled DBretrieval condition was composed on image information. This image datais called image data after composition.

[0190] What is important during the setting of a retrieval condition isto simply display which portion of displayed image data of an object ofretrieval an area to be retrieved corresponds to. What is importantafter the composition of an image is the contents of image informationin the area to be retrieved. Therefore, to use different imageinformation as a function sheet in accordance with either the situationwhich is during the setting of the retrieval condition or the situationwhich is after the composition of the retrieval condition and the image,is effective for an operation of referring to image information.

[0191] In generation of the image data, each image data is into thefunction sheet data table 630 b and a leading address of the table 630 bis stored into the column 611 b of the table 600 b.

[0192] As mentioned above, when a retrieval condition concerning an areato be retrieved is inputted, image data representing the area to beretrieved is displayed together with image data of an object ofretrieval. Therefore, the user can abstract an intended object easilywhile globally grasping a map of the object of retrieval.

[0193] On the other hand, in the case where the retrieval is to bechanged, a mode of changing the retrieval condition is set and thereturns into a waiting condition until a function sheet to be subjected tothe change of the retrieval condition is selected. When the functionsheet is selected through the operation of the cursor 1017 by the user(step 9065), step 9070 is performed. The details of step 9070 hasalready been mentioned.

[0194] Next, a process for setting the retrieval condition is performed(step 9075) so that values are set into the parameter table 600 b. Then,a DB retrieval process is performed (step 9080) and the flow returns tostep 9040. According to the present invention, after the retrievalprocess has been performed, a retrieval process can be performed againin a state in which the result of retrieval is being displayed.Therefore, the next retrieval condition can be set while referring tothe preceding result of retrieval or it is possible to easily make theretrieval in a trial-and-error manner. An example of the display screenat this time is shown in FIG. 34A. An area 1040 b is a DB retrievalcondition setting window and the result of DB retrieval is displayed inan area 1075 b. According to the present invention, since anotherfunction sheet can be generated again after the retrieval condition hasbeen set, it becomes possible to make an analysis based on a retrievalwith a retrieval condition changed for each area. An example of thedisplay screen at this time is shown in FIG. 34B. Image datarepresenting a locational requirement is displayed in areas 1036 b and1037 b, and the result of DB retrieval is displayed in areas 1076 b and1077 b. The details of the areas 1037 b, 1040 b and 1075 b to 1077 bwill be explained later on.

[0195] The details of the retrieval condition setting process 9075 isshown in FIG. 26.

[0196] In the retrieval condition setting process 9075, the judgement ismade as to whether or not the retrieval condition settlement menu 1031shown in FIG. 30A is selected (step 90100). In the case where the menu1031 is selected, the already inputted parameters are stored into thetable 600 b and the DB retrieval condition setting window, if it isdisplayed, is erased (step 90130).

[0197] In the present embodiment, step 90130 is performed in accordancewith an input for selecting the settlement menu 1031. However, step90130 may be performed in accordance with the detection of, for example,the detachment of a finger from the button of a mouse or the detachmentof a pen from a tablet. Further, step 90130 may be performed inaccordance with an input for indicating the modification or movement ofimage data of a function sheet, that is, the change of an area to beretrieved.

[0198] The setting of parameters necessary for retrieval into the tables600 b and 620 b and the resulting turn from the condition setting modeinto the settlement mode are called the composition of a function sheet.Image data of the function sheet displayed on the display device 5 whenthe function sheet was composed is the above-mentioned image data aftercomposition. A displayed example of the image data after composition isdenoted by reference numeral 1035 b in FIG. 30B.

[0199] In the case where it is determined as the result of judgement instep 90100 that the settlement menu is not selected, either (1) thesetting of locational requirement or (2) the setting of DB retrievalcondition is judged. A method of starting each setting will now beexplained using a displayed example of FIG. 30A in which image data of afunction sheet for setting is shown.

[0200] (1) The setting of locational requirement is started when aportion other than an area 1034 b of an area 1033 b, in which image datafor setting is displayed, is selected by the cursor 1017. A method mayalso be used in which the setting of locational requirement is startedin accordance with the detection of the detachment of a finger from thebutton of a mouse or the detachment of a pen from a tablet and theboundary of an area to be retrieved is set and displayed in accordancewith the position of the cursor 1017 at that time and the position ofthe cursor 1017 when the mouse button was depressed. The setting of DBretrieval condition is started by selecting the area 1034 b or the area1032 on the menu 1013. Like the menu 1013, the area 1034 b is an areafor indicating the display of a DB retrieval condition setting window.

[0201] The provision of the menu for start of the setting of DBretrieval condition in image data for setting a locational requirement,as shown in FIG. 30A, reduces the amount of movement of the cursor,thereby facilitating the change-over of the setting of retrievalcondition. This is effective particularly in the case where the size ofdisplay screen is large as compared with the amount of movement of thecursor per unit time.

[0202] When the user operates the image data for setting by use of thecursor 1017 after the start of the setting of locational requirement hasbeen indicated, an image corresponding a function sheet subjected tochange is displayed on the display device 5 each time the position orsize of the image data is changed (step 90110). Thereafter, until theinstruction for DB retrieval condition setting menu 1032 or theselection of the settlement menu 1031 is inputted, an area where theimage data for setting is being displayed is detected and an area of thegenerated function sheet to be retrieved is determined (step 90115).Values (X, Y coordinates and size of the area of the generated functionsheet) determined in step 90115 are stored into the columns 602 b and606 b of the table 600 b (step 90130).

[0203] (2) When the start of setting of DB retrieval condition isindicated, a DB retrieval condition setting window 1040 b is displayedon the display device 5, as shown in FIG. 31A (step 90120). This window1040 b is generated referring to the table 620 b. In step 90125, adisplay style, a set value for a retrieval item and an instruction forwhether or not the result of retrieval for the retrieval item should bedisplayed are inputted into the window 1040 b from the input device 3.Further, a comparative requirement 612 b shown in FIG. 23 is inputted asa DB retrieval condition. A preset sheet number or a sheet number offunction sheet designated by the user by use of the cursor 1017 is usedas a pointer sheet number 613 b. An operator 614 b of sheets is set byan input from the keyboard or the selection from displayed menus. Thesevalues are stored into tables 600 b and 620 b in step 90130, as hasalready been mentioned. By setting a specified value beforehand definedas the pointer sheet number, a retrieval condition possessed by acertain function sheet is linked with a retrieval condition possessed bythe preceding generated function sheet on the basis of an operator ofsheets included in the certain function sheet and a retrieval process isperformed. As a result, there is no need to set the pointer sheet numbereach time.

[0204] As mentioned above, since the user can make an instruction forsetting of the locational requirement after the start of the setting ofDB retrieval condition is indicated so that the window 1040 b isdisplayed as shown in FIG. 31B, it is possible to freely select theorder of setting a positional retrieval condition and a retrievalcondition for DB retrieval.

[0205] The window 1040 b shown in FIG. 31B is composed of input areas1041 and 1042 of display style, input areas 1043 to 1047 for set valuesfor retrieval items, and areas 1048 to 1052 for setting whether or notthe retrieval results for the retrieval items 1043 to 1047 should bedisplayed. For example, the result of retrieval, in the case where aninstruction for DB retrieval of data showing the age of seventy or olderthan that is made for the area 1047, is shown in FIG. 33. Theexplanation of FIG. 33 will be made later on.

[0206] Next, the DB retrieval process 9080 will be explained using FIG.27.

[0207] First, a search for primary link information included in the areato be retrieved determined in step 90115 shown in FIG. 26 is made usingthe link information DB 300 and the searched-out primary linkinformation is stored into the hit link tables 700 and 710 shown in FIG.8 (step 90200). In the case where a plurality of function sheets aregenerated, those ones of primary link information included in the linkinformation DB 300, which has a correspondence to image informationdisplayed in the area 1018, are stored into the tables 700 and 710. Eachcolumn of the sheet number 711 and the flag column 714 have “−1” set asan initial value. When data is stored into the table 700, “0” is setinto each of the columns 711 and 714. On the basis of the determinedlink information, primary link information having a flag of “0” in thecolumn 714 is displayed in the image information display area 1018 (step90205). A displayed example of link information is shown by marks 1061 bto 1069 b in FIG. 32A.

[0208] At the same time, the DB retrieval is made for the primary linkinformation determined in step 90200 on the basis of the attributeinformation DB's 100 and 110 and the DB retrieval condition stored inthe retrieval item table 620 b (step 90210). In the present embodiment,the DB retrieval is made after the retrieval of an area. However, in thecase where the number of primary link information is great, theabstraction of primary link information may be made after the DBretrieval.

[0209] As the result of DB retrieval, “1” is set into the column 711 ofthe table 710 for the corresponding primary link information. Also,referring to the column 711 and the column 612 of the table 600, “1” isset into the column 714 for the corresponding record so that a flag isset (step 90215). Next, those ones of the primary link informationdisplayed in step 90205 having a set flag of “1” in the column 714 aredisplayed as they are, and those ones thereof having a value other than“1” in the column 714 are not displayed (step 90220). Marks 106 a, 106b, 106 c and 106 d shown in FIG. 32B are link information concerning theprimary link having the set flag in the column 714. In FIG. 32B, theprimary link information to be displayed in step 90205 and the primarylink information to be displayed in step 90220 are displayed withdifferent colors, thereby displaying different link informationsimultaneously on the same screen. However, the marks indicating thedifferent link information may be displayed with different shapes orthere may be used a method in which any link information is notdisplayed in step 9025 and only the primary link information obtained instep 90220 is displayed.

[0210] In the present invention, since primary link information includedin an area to be retrieved and primary link information abstracted fromthe earlier-mentioned primary link information in accordance with a DBretrieval condition are displayed, it is possible to know to what extentthe objects corresponding to a DB retrieval condition are included inobjects on an image map linked with DB information. Further, thereference to the outline of the already obtained result of retrieval canbe made in changing a retrieval condition.

[0211] Information of the attribute information DB concerning theprimary link information having a set flag in the column 705 is readreferring to the columns 701 and 702 (step 90225). Referring to thedisplay style 610 b of the table 600 b and the flag 626 b indicatingwhether or not the result of DB retrieval should be displayed, data fordisplay of the result of DB retrieval is generated from the read DBinformation (step 90230). The generated data is displayed on the displaydevice 5 (step 90235). A displayed example of the result of DB retrievalis shown in FIG. 33. The results of retrieval are displayed in areas1071 b to 1074 b. As is shown, values set in step 90125 are such that afull name and an address are displayed as the result of DB retrieval andthe display style is a style of displaying a display area in a card formfor the corresponding primary link information. A retrieval conditionrepresented by text information of the age of seventy or older than thatis displayed in an area 1034 b of the function sheet. In the presentembodiment, the display area of the card form and a corresponding pointsuch as the mark 106 a shown in FIG. 32B are linked in a predetermineddisplay form. However, a display method as shown in FIG. 35A, which willbe mentioned later on, can be used so that a card 2002 indicating therecord number 102 or 112 of the corresponding attribute information DBtakes a fixed position relative to a mark 2001 corresponding to linkinformation. Also, in the case where the area 1041 shown in FIG. 31B isselected in step 90125, the results of retrieval of a plurality of DB'sare displayed in one table.

[0212] Since the correspondence of the result of DB retrieval to aposition on a map corresponding thereto is simply displayed, asmentioned above, the user can confirm the individual result of retrievalwithout losing sight of a correspondence to image information.

[0213] Finally, displayed examples of the result of DB retrieval using aplurality of function sheets are shown in FIGS. 35A and 35B. In FIG.35A, two function sheets having substantially the same size are arrangedoverlapping. This overlapping shows that the DB retrieval is made with aplurality of retrieval conditions for one area. In FIG. 35B, functionsheets having different sizes are arranged in a partially overlappingmanner. In FIG. 35B is displayed the result of retrieval by a retrievalcondition in which a retrieval condition possessed by a function sheet2003 and a retrieval condition possessed by a function sheet 2004 arelinked by “AND”. Namely, in FIG. 35B are displayed those ones of primarylink information satisfying a locational requirement of the functionsheet 2003 and a locational requirement of the function sheet 2004 whichsatisfy a DB requirement of the function sheet 2003 and a DB requirementof the function sheet 2004. In FIG. 35A, the display is made so that acard 2002 indicating the record of the corresponding attributeinformation DB takes a fixed position relative to a mark 2001corresponding to link information.

[0214] According to the present invention, when text information havinga correspondence to image information is to be retrieved, there are madea quantitative retrieval which uses a retrieval key called aninformation lens including the partial overlaying of the original imageinformation (or map information) with another information for retrievaland a qualitative retrieval in which the retrieval is made with theoriginal image information (or map information) being overlaid with aretrieval key called a function sheet including the composition of aqualitative retrieval condition and an image indicative of a range ofapplication of the retrieval condition. Thereby, the following effectsare obtained. Namely, since massive text information is filtered orsubjected to screening in the level of image by the quantitativeretrieval, the amount of text information to be retrieved in more detailis reduced and hence a time required for retrieval is reduced. Also,Since the application range of the quantitative retrieval condition canbe set by an image in the qualitative retrieval, a user can easily setthe application range of the quantitative retrieval condition whiletaking the whole of the original image information into consideration.Further, an effective information retrieval making the best use of theabove effect can be made by properly combining the quantitativeretrieval and the qualitative retrieval in accordance with the result ofretrieval.

[0215] According to the present invention, with a construction in whichanother image information is displayed in a form composed on imageinformation displayed on a screen, it is possible to grasp the otherimage information in an intended area while seeing the state of theenvironment and to search for the intended area so that information inthat area is retrieved from a DB. At this time, such image compositionor generation image as will be mentioned in the following is possible.

[0216] 1) The other image information including detailed information canbe composed in a local area on the image information displayed on thescreen. Thereby, the other detailed image information is added in only anecessary area on the original image information.

[0217] 2) A magnified version of the other image information includingdetailed information can be composed in a local area on the displayedimage information. Thereby, it is possible to easily grasp the otherimage information including detailed information, too.

[0218] 3) The other image information including detailed information canbe composed in a local area on the displayed image information andwithin a range in which a distance from the center is fixed. Thereby,the other image information in the fixed range around an intended pointis displayed always.

[0219] According to the present invention, since a positional retrievalcondition can be inputted by merely operating image informationdisplayed on a display device, it is possible for the user to input anarea to be retrieved without referring to text informationrepresentative of the position of the image information being displayed,thereby facilitating the input of the positional retrieval condition.

[0220] The preceding set value can be set as an initial value ingenerating a function sheet. Therefore, in the case where a part of aretrieval condition is to be changed, a condition setting time can beshortened. By providing a representative point representing an object ofimage information, a retrieval throughput at the time of retrieval ofprimary link information from an area to be retrieved is reduced,thereby shortening a retrieval time. Since the shape of a function sheetcan be changed in accordance with an object of retrieval, analysisadapted for the property of an area becomes possible.

[0221] Since the format for DB retrieval is generated referring to anattribute information DB, the user can set a retrieval item even if theuser does not know the contents of the attribute DB beforehand.

[0222] What is important during the setting of a retrieval condition isto represent which portion of displayed image information of an objectof retrieval an area to be retrieved corresponds to. What is importantafter the composition of image information with a function sheet is thecontents of image information in the area to be retrieved. In thepresent invention, therefore, it is possible to use different imageinformation as a function sheet in accordance with either the situationwhich is during the setting of the retrieval condition or the situationwhich is after the composition with the retrieval condition.

[0223] According to the present invention, when a retrieval conditionconcerning an area to be retrieved is inputted, image data representingthe area to be retrieved is displayed together with image data of anobject of retrieval. Therefore, it becomes easy to abstract an intendedobject while globally grasping a map of the object of retrieval.

[0224] According to the present invention, after a retrieval process hasbeen performed, the retrieval process can be performed again in a statein which the result of retrieval is being displayed. Therefore, the nextretrieval condition can be set while referring to the preceding resultof retrieval. Namely, it is possible to easily make the retrieval in atrial-and-error manner.

[0225] Since another function sheet can be generated again after aretrieval condition has been set, it becomes possible to make ananalysis based on a retrieval with a retrieval condition changed foreach area.

[0226] By providing a menu for start of the setting of DB requirement inimage data for setting a locational requirement, the change-over of thesetting of a retrieval condition is facilitated. This is effectiveparticularly in the case where the size of the display device is largeas compared with the amount of movement of a cursor per unit time.

[0227] Since it is possible to make an instruction for setting of thelocational requirement even after the start of the setting of DBretrieval condition is indicated so that a retrieval condition settingwindow is displayed, it is possible to freely select the order ofsetting a positional retrieval condition and a retrieval condition forDB retrieval.

[0228] Since primary link information included in an area to beretrieved and primary link information abstracted from theearlier-mentioned primary link information in accordance with a DBretrieval condition are displayed, it is possible for the user to knowto what extent the objects corresponding to a DB retrieval condition areincluded in objects on an image map linked with DB information. Further,the user can refer to the outline of the result of retrieval in changinga retrieval condition.

[0229] Since the correspondence of the result of DB retrieval to aposition on a map corresponding thereto is displayed on the screen, theuser can confirm the individual result of retrieval without losing sightof a correspondence to image information.

1. A method of retrieving a database with image information comprisingthe steps of: (a) reading a first image information, a database in whichtext information linked with the image information is stored andrelevant information from a storage device; (b) retrieving textinformation corresponding to a second image information displayedoverlaying said first image information displayed on a display devicefrom said database on the basis of a first user instruction from aninput device and storing the text information into a work file togetherwith said first image information and relevant information; and (c)composing a retrieval condition and a range of application thereof asimage data on the basis of a second user instruction from said inputdevice, retrieving text information corresponding to said image datadisplayed overlaying said first image information displayed on saiddisplay device from said work file, and outputting the result ofretrieval to said display device.
 2. A method according to claim 1,further comprising the step of: (d) repeatedly performing said steps (a)to (c) or said step (c) on the basis of an instruction from said inputdevice by the user.
 3. A method according to claim 1, wherein said step(b) further includes the steps of: (b1) displaying said first imageinformation on said display device; (b2) changing an image of aspecified area of said second image information linked with said imageinformation on the basis of said first instruction from said inputdevice and displaying the changed image in a composite form with saidimage information; and (b3) retrieving information corresponding to saidsecond image information from said database stored in said storagedevice in a form linked with said first image information.
 4. A methodaccording to claim 3, wherein said step (b3) further includes:retrieving the information corresponding to said second imageinformation in a form linked with said image information, said imageinformation or both the image information from said database stored insaid storage device in the form linked with said first imageinformation.
 5. A method according to claim 1, wherein said step (c)includes the steps of: (c1) composing image data by a retrievalcondition represented by text information and an image representing arange of application of said retrieval condition on the basis of aninstruction from said input device by the user; (c2) displaying saidimage data overlaying said first image information on said displaydevice; and (c3) retrieving information corresponding to said image datafrom said database stored in said storage device in a form linked withsaid first image information.
 6. A method of retrieving a database withimage information, comprising the steps of: (a) reading a first imageinformation, a database in which text information linked with the imageinformation is stored and relevant information from a storage device;(b) displaying said first image information on a display device; (c)changing an image of a specified area of second image information linkedwith said first image information on the basis of an instruction from aninput device and displaying the changed image in a composite form withsaid first image information; and (d) retrieving informationcorresponding to said second image information from said database storedin said storage device in a form linked with said first imageinformation.
 7. A method according to claim 6, wherein said step (d)includes: retrieving the information corresponding to said second imageinformation in a form linked with said first image information, saidsecond image information or both said first and second image informationfrom said database stored in said storage device in the form linked withsaid first image information.
 8. A method according to claim 6, furthercomprising the step of: (e) repeatedly performing said steps (a) to (d)on the basis of an user instruction from said input device.
 9. A methodof retrieving a database with image information, comprising the stepsof: (a) composing image data by a retrieval condition represented bytext information and an image representing a range of application ofsaid retrieval condition on the basis of an instruction from an inputdevice; (b) displaying said image data overlaying image information on adisplay device; and (c) retrieving information corresponding to saidimage data from a database stored in said storage device in a formlinked with said image information.
 10. A method according to claim 9,further comprising the step of: (d) repeatedly performing said steps (a)to (c) on the basis of an user instruction from said input device.
 11. Amethod according to claim 3, wherein in said substep (b2), a magnifiedversion of said second image information including detailed informationis composed in a local area on said first image information.
 12. Amethod according to claim 3, wherein in said substep (b2), said secondimage information including detailed information is composed in a localarea on said first image information and within a range in which adistance from a center set by the user is fixed.
 13. A method accordingto claim 3, wherein in said substep (b2), a modified version of saidsecond image information including detailed information is composed anddisplayed in a local area on said first image information by use of thecorrespondence of said first image information to said second imageinformation to be composed thereon.
 14. A method according to claim 1,wherein in said step (c), a plurality of image data including thecomposition of different retrieval conditions and the ranges ofapplication thereof are displayed overlaying said first imageinformation displayed on said display device on the basis of aninstruction from said input device by the user, text informationcorresponding to the result of a logical operation defined by saidplurality of image data is retrieved from said work file, and the resultof retrieval is outputted to said display device.